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Abstract 

We show global uniqueness of the solution to a class of constrained 
variational problems, using scaling properties. This is used to establish 
the essential uniqueness of solutions of a large deviations problem in 
multiple dimensions. The result is motivated by models of buffers, and 
in particular the probability of, and typical path to overflow in the 
limit of small buffers, which we analize. 

keywords Uniqueness of Variational problems, Large Deviations, Buffer 
overflow, AMS model. 

1 Introduction 

We investigate uniqueness of solutions to variational problems that arise in 
sample-path large deviations. Our motivation comes from models of buffers 
in telecommunication systems. The original model was developed by Anick, 
Mitra, and Sondhi [T| . Weiss [TT] cast this model in the framework of sample- 
path large deviations and showed for the probability of buffer overflow 

Urn -\ogF(bnit)>B)= inf [ i(f(t),f'(t))dt, (1.1) 

n^oo n (r ,T)eG(B) Jq 
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where £{f{t),f'{t)) is a positive "cost" function, and G{B) is the set of 
paths r (d-dimensional functions of t) and terminal times T satisfying a 
buffer overflow property (see §[7]). Botvich and Duffield [2] (and indepen- 
dently Courcoubetis and Weber |3j and Simonian and Guibert [7]) analyze 
the probability of buffer overflow for more general traffic models. For a su- 
perposition of n traffic sources, each bringing independent traffic A{t) to the 
buffer in time (0, i), and with the buffer draining at rate nc for some con- 
stant c, they show that the steady-state probability that the scaled buffer 
content bn{t) = b{t)/n exceeds a level B is approximately 



lim -logP(6„(t) > B) 



inf sup\ e{b + ct) - log E (exp(M(t))) | . (1.2) 



For more recent results see e.g. Mandjes and Mannersalo [6] and references 
therein. Mandjes and Ridder [5] showed how to use the solution of (jl.2p to 
find a minimal sample path r (t) in (11. 1[) : that is, a solution to the variational 
problem. If this solution is unique, then this result is quite useful, as shown 
by Freidlin and Wentzell [4J: if Zn{t) represents the scaled state of the system 
at time t, bn{t) the scaled buffer size, and f{t) is the unique solution to the 
variational problem (jl.ip . then for each fixed s <T, 



hm P, 



sup 

s<t<T 



\zn{t)-r{t)\ < e 



bn{T) >B\=1. 



:i.3) 



Here P^s is steady-state probability and P(yl|i?) is the probability of A condi- 
tioned on B. Thus, conditioned on the buffer overflowing, we can determine 
beforehand most likely how it did so. So the sample-path approach yields 
interesting information when the minimizing r{t) is unique. 

The general problem of uniqueness for variational problems is difficult. 
In general, it is difficult to prove local uniqueness for variational problems, 
and global uniqueness is even more difficult. In addition, our problem is an 
optimization problem under a constraint (buffer exceeds B). Constraints can 
often be handled using Lagrange multipliers, so that standard uniqueness 
methods can be applied. However, this requires a proof that the multiplier 
principle holds in this case. Note that due to our application, the minimum 
must be shown to be unique in the class of absolutely continuous paths, not 
simply or piecewise paths. Finally, in terms of the application, there 
seem to be no direct probabilistic methods for establishing uniqueness. 

In this note we consider a constrained variational problem where the 
constraint is given by a single functional. We assume a certain scaling prop- 
erty of the constraining functional together with homogeneity, convexity 
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and superlinear growth of the Lagrangian I to show global uniqueness of 
the minimizing solution. For our motivating model this means the follow- 
ing. In previous studies of this model ([8], Chapter 13) we showed, through 
laborious calculations, the applicability of the multiplier principle as well 
as uniqueness, for a simple one-dimensional case. We show here that the 
assumptions of our new uniqueness result hold for a constant coefficient pro- 
cess. Then we approximate our model with a constant coefficient one and 
show that, in the limit as the buffer size -B — > 0, the variational problem 
has an essentially unique solution, in the following sense. There is a unique 
path r*{t), < t < T, for the constant coefficient process, such that any 
minimizing path r _B(t) of the real process is close to a scaled version of r *(f): 

hm^ (rBitVB) - f b(0)) + r *(0) = f*{t), 0<t<T, (1.4) 

uniformly in t, and r_B(0) — > r*(0). In other words, for each e > there is 
a (5 > such that for all B < 6, 



sup 

0<t<T-5 



1 



tV^) -fB(0)) -(r*(t)-f*(0)) 



< £. (1.5) 



The conditions under which this result holds are mild. 

Note that this result together with a local uniqueness result for the orig- 
inal model — for small enough B — imply that there is a unique solution for 
all B small enough, for each given starting point. We do not give general 
conditions for the uniqueness of the full buffer model, but some discussions 
appear in § [8l Our result does not imply full sample-path uniqueness for 
the stochastic model with non-constant rates, although we are certain that 
uniqueness does hold. In paticular, we have no effective bounds on the error 
(the relationship between e and 6 in (jl.5p ). 

In §[2] we introduce the general variational problem, and in §[3] we state 
the abstract assumptions under which uniqueness holds. Sections S] and [5] 
prove existence and uniqueness resp. In §[6] we derive a property of the shape 
of optimal paths for buffer problems. In § [7] we formulate the stochastic 
buffer problem and obtain some properties, in §[8] we prove weak uniqueness 
and in § [9] we show a strong uniqueness result and discuss the desired full 
uniqueness result. 
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2 The variational problem 



We assume throughout that the functional /[o,t](^) on absolutely continuous 
paths f{t) (d-dimensional functions of a real variable) has a representation 

I[o,T]ir) = £i (r (t), |r (O) dt, (2.1) 

where i{x,y) is a positive function, convex in y. The constant coefficient 
problem has £{x, y) = t{y) — independent of x. We prove our uniqueness re- 
sult for a general class of constraints. So, let B be a given positive functional 
on absolutely continuous paths. Our optimization problem is 

Problem A. Given x and 5 > 0, find a time T and an absolutely continuous 
path f{t) that minimize I[q^t]{^) subject to B{r,T) > B. 

Denote this minimal cost by X. This is a "free time" problem; hence 
straightofrward convexity arguements cannot be used to infer uniqueness. 

3 Assumptions 

Throughout, we use the sup norm on the space of (measurable) functions. 
The following assumptions apply to the constant coefficient problem. We 
shall use all save the last assumption in order to prove existence of solutions 
to Problem A, and a different subset to prove uniqueness of solutions. 

Assumption 1 

[A] £{y) is positive and strictly convex in y. 
[Bj hm £{y)/\y\=^. 

[C] B{f,t) is positive, continuous in {r,t), and B{f,0) = 0. 

[D] For some s, i{s) < oo and lim(_>oo I3{f, t) = oo for f{t) = x + ts. 

[E] Given x and B there is aTi < oo such that any path f{t) onO <t <T 
with T > Ti, f(0) = X and B{r,T) > B has /[o,t](^) > 2:+ 1. 

[F] For all f{t) and z{t) onO<t<T with r (0) = z{0) =x,B satisfies 

1. For any 7 G (0, 1) and < t < T we have 

B{-ff + (1 - j)z, t) > jB{f, t) + (1 - 7)B{z, t). (3.1) 
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2. There exists a positive increasing function f{a), defined for a > 
0, that satisfies f{a)f{l/a) = 1, and is either the identity (f{a) = 
a), or is strictly convex for a > 1 such that for every r{t) on 

< t < T , the scaled path y{t) = af{t/a) satisfies 

B{y, t) = f{a)B{f, at) < t < aT (3.2) 
Note that Assumption [1] [A] implies for any 7 E (0, 1) we have 

^[o,T](7^ + (1 - 7)^) < lIlo,T]{r) + (1 - 7)I[o,T]{z), (3.3) 

where the inequality is strict unless f (t) = z{t). Furthermore, the repre- 
sentation of / as an integral implies that, for y defined in terms of r as in 
Assumption [I][F] 2, I[o,aT](y) = "-f[o,r](^)- 

The prototypical /(a) satisfying [F] 2 is /(a) = for /3 > 1. Our 
motivating example has /3 = 2; see (16. ip . The conditions do not imply that 
f{a) is convex for a < 1. They imply that /(I) = 1 and /(a) ^ as a — > 0. 

4 Existence 

The real import of this paper is uniqueness; for completeness, we prove 
that for the constant coefficient problem, there exist solutions to Problem 
A under our assumptions. 

Theorem 1 Under Assumption{l\ parts [A]-[E], there exists a solution to 
Problem A. 

Proof: By Assumption [1] [D] the linear function f{t) = x + ts has 
-^[o,T](^) < ^ ^iid makes B{f,T) > B for T large enough. Therefore we are 
not minimizing over an empty set. By Assumption [1] [E] we may restrict to 
minimizations over sets of bounded time. 

Take a minimizing sequence r j on [0, Tj] with B{fi, Ti) > B and r i(0) = 
X. To prove existence of an optimal f we need to show that a converg- 
ing subsequence of approximate minimizers has a minimal limit. By [8l 
Lemma 5.18], under Assumption [1] [A] and [B], a set of paths fi{t) over a 
bounded interval [0,T], having ri(0) in a compact set, and with bounded 
/-functions, is uniformly absolutely continuous, hence pre-compact. There- 
fore, since any minimizing sequence has bounded T, there exists a con- 
vergent subsequence, and the limiting path r{t) is absolutely continuous. 
Again under Assumption [1] [A] and [B], [81 Lemma 5.42] shows that the 
functional /[o.r] is lower semicontinuous in r ; therefore, the limiting path 
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satisfies /[o,t](^) ^ -^[o,T](^i)- The continuity of B in {f,T) sliows that 
B{r,T)>B. ' m 

5 Uniqueness 

In this section we estabhsh that the solution to the constant coefficient 
problem is unique. Note that this is only interesting because Problem A 
has the constraint i3(r , T) > B and T is not determined. If we were simply 
trying to minimize /[o^t]('^) with fixed initial and final points, it is trivial to 
show that the unique solution is a straight line path (e.g., [S', Lemma 5.15]). 

Theorem 2 Fix x and B > 0. Suppose AssumptionUl [A], [B], [C], and [F] 
hold. Ifr{t) <t <T and y{t) <t <Ti solve Problem A, then T = Ti 
and f{t) = y{t), 0<t<T. 

Note: in the proof, we need to rescale time in part because the optimal 
paths may live on different time intervals. 

Proof: Without loss of generality assume Ti > T. Define a = Ti/T > 1. 
By assumption, 

I[o,T]{r)=T B{f,T)>B 
I[o,aT]{y)=^ Biy,aT)>B. 

Take u{t) = af{t/a). Then /[o,qT](^) = aiid B{u,aT) > f{a)B. Now for 
any < 7 < 1 define v = jy{t) + (1 — j)u{t). Then we have 

I[o,aT]i^) < (7 + (1 - 7)a)X, B{v, aT) > (7 + (1 - l)f{a))B. (5.1) 

Now scale v to get w{t) = 6v{t/6). Then we have 

%5aT](^)<5(7+(l-7)«)X, B{w,5aT) > f{6){j + {l-j)fia))B (5.2) 

where the first inequality is strict unless u = y. Note that since /(I) = 1, 
so 7 + (1 - 7)/(a) = 7/(1) + (1 - 7)/(a), we have by that 

B{w,5aT)> f{6)f{^+{l-^)a)B (5.3) 

by the strict convexity of /, as long as a > 1 and / is not the identity. If 
there is strict inequality in (j5.3p . we may find a 5 < 1/(7 + (1 — 7)0) so 
that B{w,6aT) > B. But then by (|5.2p . /[o,<5qT] ("W^) < contradicting the 
assumed minimality of I. If / is the identity, so that inequality (|5.3p is not 
strict, then we choose 5 = 1/(7 + (1 — 7)a), and get a contradiction to the 
assumed minimality of X from the strict inequality in (|5.2p . ■ 
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6 Integral constraint: concave buffer 



This section ihustrates our assumptions on B, and derives a result of inde- 
pendent interest for the study of properties of buffer models. This result 
is not needed for the main argument. We consider the constant coefficient 
problem, and a functional B that is a the traditional buffer model, and show 
that optimizing paths have to be concave in a preferred direction. For a 
given vector a with positive components, we take 

dt 1 otherwise, 

B{f, 0)=0. (6.2) 

Clearly B satisfies Assumption[T][C]-[Dj3; we discuss [E] later. We now show 
[F]. 

Lemma 3 For any integrable function g{t), we have 

A 



Uait) = / ag{w/a) dw = a ui{t). (6.3) 

J as 

Lemma 4 B{f,t) defined by (j6.ip . (|6.2|) satisfies 

B{r,t)= sup / {f{w),a)dw. (6-4) 

0<s<tJs 

Corollary 5 Given f{t) set y{t) = af{t/a). Then B{y,T) = a^B{r,aT). 

These results are immediate; for a proof of Lemma[l]see O §13.2], [9]. 

We begin with an intuitive result: optimal paths never have (r (i), a) < 0. 
If they did, then the buffer could be increased and the cost I decreased by 
eliminating the point. The proof is exactly this argument, but we must 
account for the shifting of time and position (shift segments of paths to 
make them continuous) that come from eliminating intervals of time. 

Lemma 6 Any minimal r{t), < t < T with (r(0),a) > satisfies 
{r{t),a)>0,te [0,T]. 



^[D] holds provided £{s) < oo for some s with (s, a) > 0. 
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Proof: Eliminate any times with {f{t),a) < 0, then reconstitute f. 
Mathematically, let 

s{t) = / l(^^^^u),a)>odu; (6.5) 
Jo 

Let r(g) = inf{t : s{t) = q} be the first time by which (r (u),a) > for a 
total time of q. Then t{s{p)) = s(r(p)) = p, that is, r and s are inverses. 
Then define 

/•^(*) d 

fi(t)=r(0)+/ —f(s(u))du. (6.6) 
Jo 

This is well defined since r is absolutely continuous. The path ri(t) has 
the same increments as the path f(t) once the times {f{t),a) < are 
eliminated, and it is continuous. Clearly /[o,t](^) ^ ^[o,s{T)]{^i)- But if 
B{f,T) = B > then B{fi,s{T)) > since the two functions are equal 
at corresponding (shifted) times whenever (r(t),a) > 0; see ()6.ip or ()6.4p . 
In fact, if {f{t),a) < anywhere, then 5(ri,s(T)) > B. But in this case, 
by the continuity of B (assumption [1] [C]) and its definition, there is some 
Ti < s{T) so that B{fi,Ti) = B and, by definition (j2.ip . since £ is positive, 
I[o,T]{^) > I[o,Ti]{^i)^ SO that r is not optimal . ■ 



Lemma 7 Given B, T and x with {x,a) > 0, any f{t) with r (0) = x that 
has B{r',T) = B and has minimal cost I[o,t](^)) f^^-s the property that the 
function (r (i),a) is concave, < t < T . 

Proof: Suppose that the function {f{t),d) lies strictly below its concave 
envelope for some L < t < M. Let v(t) denote the concave envelope of 
{f{t),a); hence v{t) is linear on [L, M]. By [S*, Lemma 5.15], replacing r 
with a linear function over the interval [L, AI] strictly decreases /, and since 
v{t) > {f{t),d) for L < t < M, by ([6T|) . B{f,t) increases for t > L . ■ 



7 Stochastic buffer model 

This section gives an overview of the connection between a class of stochastic 
traffic and buffer models and the variational Problem A. Precise definitions 
and assumptions will be given later. There are two components in the 
models: a Markov chain x{t) (called the state of the system) and the buffer 
itself. The Markov chain operates in continuous time and its state lies in 
the i^-dimensional lattice with positive integer components. There are J 
possible transitions, with transition rates Xi{x) in direction ej, 1 < i < J. 
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This means that the state jumps from x to x + ei with Poisson rate Xi{x). 
The interpretation of the state is that there are Xi sources of traffic in state i. 
There is a single buffer with continuous contents B{t). The buffer contents 
are filled by each source in state i at rate > 0, and the total buffer 
drain rate is C. Mathematically, the buffer satisfies the following equation 
(cf. dSID-dSa])): 




C ii{x{t),a)>C or B{t)>0 
otherwise. 



(7.1) 



If -B(O) = then it is easy to see that 

B{t)= sup [ {a,x{u))du. (7.2) 

0<s<t Ju=s 

We define B{x,t) as this B{t) for a given (state) sample path x{t). 

As an example, suppose that there are K = 2 types of traffic sources, 
phone and data. Type 1 sources, phone, generate traffic at rate 1, arrive at 
Poisson rate A, and depart at rate fj, each. Type 2 sources, data, generate 
traffic with rate 5, arrive at rate 9, and depart at rate ip each. Furthermore, 
a phone source can turn into a data source (a person talks for a while, then 
starts sending a fax); this occurs at rate 7 for each source in state 1, and, of 
course, a data source can become a phone source with rate 5. We suppose 
the buffer drain rate is 100. This leads to a model with the following jump 
rates and transitions: 



ei 


= (1,0) 


Ai = A 


62 


= (-1,0) 


A2 


= fJ-xi 


63 


= (0,1) 


A3 = ^ 


6*4 


= (0,-1) 


A4 


= i>X2 


65 


= (-1,1) 


A5 = 7x1 


6*6 


= (1,-1) 


Ae 


= 6X2 



^ 0/ N ] xi{t) + 5x2{t) - WO if xi(t) + 5x2(t) > 100 or 5(t) > 
— B[t) = < 

dt I otherwise. 

This is an open model, since sources arrive and depart. For Aj = 0, 1 < i < 4, 
this is a closed model: transitions are between types of sources, and the total 
number of sources is constant. We could also allow for correlated arrivals 
and departures. For example, we could have a person arrive and start to talk 
on the phone and use his email at the same time; this would be an arrival 
with 67 = (1, 1). Similarly, this type of person could depart (eg = (—1, —1)), 
stop one of his activities (e2 or 64), or a couple could start their day together 
with eg = (2, 2) etc. 
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We suppose that the process x{t) may be scaled to Zn{t) with jumps of 
Zn having size Ci/n with rate nXi{zn{t)). The scaled buffer bn{t) is defined 
similarly to (|7.ip : 

±^ ^^^^ U^n{t),a) -C if{zn{t),a)>C ovbn{t)>0 ^^^^ 
dt 1 otherwise. 

In some models C is also scaled by n so as to have a finite limit as n ^ oo. 
In general we suppose that the jump rates \i{x) keep each component of 
Zn{t) positive; that is, we do not consider "sources" that might drain the 
buffer. Clearly bn{t) = 13{zn,t) under appropriate scaling. 

We showed in [10] that, under a wide variety of assumptions on the 
Aj(x), the process Zn{t) satisfies a large deviations principle. Furthermore, 
we showed in [9l [El Chapter 13], that in a buffer model very similar to 
the one just described, statistical properties of the buffer size process may 
also be approximated by solutions to variational problems. (There have 
been many other analyses of these problems; typically, they consider steady 
state statistics. See, e.g. Mandjes and Ridder j5] or, for a non-sample- 
path approach Botvich and Duffield [2].) In particular, it was shown that 
the steady-state probability that the buffer exceeds a level B is given by 
exp(— n/+o(n)), where / is the solution to a variational problem we describe 
below. 

7.1 The variational problem for Buffer overflow 

Given the rates and jump directions, define the local cost function by 



l{x,y) = sup {0,y) - ^Ai(f) (exp{e,ei) - l) 
eeiR^ V i J 



(7.4) 



Then define the action functional, or cost of an absolutely continuous func- 
tion f{t) G 

I[0,T]{r) = £i (r (t), |r (t)) dt. (7.5) 

The variational problem associated with making a buffer exceed level B 
is given as follows. We assume that the process is typically near its steady 
state value, denoted by q, and that at that point the capacity C suffices to 
serve the traffic, namely {q, a) < C. Let I be defined by 

I = inf {lio,T]{n ■■ r (0) =q,T< oo, B{f,T) > B} . (7.6) 
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Usually the optimizing T is infinite, since the time to leave q is infinite, so 
we perform a standard shifting of time so that the upcrossing of the path r 
to the hyperplane (f , a) = C takes place at time 0. The time T after time 
required to fill the buffer is then typically finite. If there is a unique solution 
(T,f) with I[-oo,T]{^) = ^ ^iid B{f,T) > B then equation p.3|) holds; in 
other words, given a buffer overfiow, we know how it was almost certain to 
have happened. For a proof of this assertion see [8", Chapter 13]. 

The problem of finding the minimal cost path r starting from q and 
making B{f,T) > B naturally splits into finding the cheapest path from 
q to sone x with (x, a) = C, followed by the cheapest path starting from 
X making B{f,T) > B, and then minimizing the total cost / over all such 
X. This is clearly valid because the buffer cannot begin to increase until 
(r,a) > C. It is also clear that the cost I[o,t]{^) of making a buffer B 
tends to zero as i? — > (since we can take a small period of time to make 
the small buffer, and i is finite for some directions). Therefore, if there is a 
unique upcrossing point x* , then for small B, the optimal point x (in the full 
problem of making a small buffer) will be close to x* , the optimal upcrossing 
point. 



7.2 Typical behavior 

To describe the typical behavior of the state and buffer size processes, define 
the process Zqo (t) 

v{x) = '^Xi{x)ei, ^z^{t) = v{z^{t)). (7.7) 

i 

Kurtz's theorem [8l Chapter 5.1] states that, over finite time intervals, the 
process Zn{t) is extremely likely to remain close to the path Zoo{t) that starts 
at the same point -2oo(0) = ^n(O). The intuition is that v is the average drift 
of the process -?«(*), in the sense that 

lim lim ^"^ — \ "jAJ. _ v{zn{t)) = with probability one. (7.8) 

(5J,0 n^oo 

From this one can infer [9l Cor. 8] that the buffer size process 6„ is also 
extremely likely to remain close to a limiting path, which can be calculated. 

We will show next that given an initial point x with {x, a) = C, and 
given a small B, there is an essentially unique path r with r (0) = x and 
B{f ,T) > B). This clearly does not solve the full uniqueness problem, 
because although we know that x ~ x* , for each B we have no idea whether 
there is a unique associated point x. 
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8 Weak uniqueness 



We now state the assumptions under which the probabihstic problem of the 
buffer being large is described by the deterministic variational Problem A. 

Assumption 2 

A. The processes Zn{t) and bn{t) satisfy a sample-path large deviations 
principle; the rate function for Zn is Iio,T] ■ 

B. There is a unique globally attracting point q of Zoo{t). 

C. {q, a) < C. 

D. The Freidlin-Wentzell theory 18^ Chapter 6] applies to both Zn{t) and 

hn{t). 

E. There is a unique endpoint x* of the upcrossing problem from q to 
{x : {x, a) = C}. 

F. {x*,v{x*)) < 0. 

Since i3 is a continuous functional, the assumption that the buffer process 
satisfies a large deviations principle is a consequence of the fact that Zn 
satisfies the principle, and the rate function for can be derived from 
^[o,r] P, §2.3]: see e.g. P Cor. 8]. 

Theorem 8 Let P^s denote steady state probability. Under Assumptions^ 
lim - logFss{B{zn,t) > B) = -inf {/[o,T](r) : f (0) = g, B{r ,T) > B] . 

Furthermore, iff is unique to within a time shift, then (shifting time so that 
the buffer overflow takes place at time t = 0) the estimate (jl.3p holds. That 
is, Zn{t) ~ f(t) over each fixed interval of time before the time of overflow, 
assuming that overflow occurs at time T . 

The proof of Theorem [8] is standard from the Freidlin-Wentzell theory, 
and will not be given here; see [4] or [8l Chapter 6, 13]. However, we must 
explain when Assumption [2] can hold. Part A was proved in ^lOj, under the 
following conditions. The process Zn{t) is assumed to live on the positive 
quadrant G (in fact, the domain G in [lOj is quite general). The jump rates 
Aj(x) were assumed Lipschitz continuous, strictly positive in the interior 
of the domain G, and \i{x) — > as x — > y G dG for every i such that 
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a jump in direction from y would take Zn out of G. The associated Cj 
were assumed to positively span all of M-^ (that is, for any x G there are 
/3j > such that x = SiPi). There were some further technical conditions 
that are quite minor and will not be described here. Part B of Assumption 
[2] is simply that the process Zn{t) tends to go to a small neighborhood of 
q. Part C means that the buffer B(t) tends to decrease when the process 
is in its most likely state. Part D implies that steady-state quantities can 
be calculated from the transient sample-path large deviations principle jSl 
Chapters 6,13]. Part F means once the process Zn{t) reaches the most likely 
point where the buffer can begin to fill, the process tends to go in a direction 
that has the buffer decrease. This means that, most likely, even when the 
buffer begins to fill, it will almost immediately begin to decrease. 

The assumptions can be largely eliminated if we change the question we 
ask. Suppose we want to know how the buffer fills, starting from some point 
X with {x, a) = C, and how likely it is to fill to a level B. 

Theorem 9 Under Assumptionl^ A, given x with {x,a) = C, 



1 



lim -logP(i3(z„,T) > B) = -inf {/[ 



[0,T] ( 



(0)=f, T, B{f,T)>B} 



n^oo n 

Furthermore, if r ( and T < oo) are unique then for every e > 



lim P 



sup 

, 0<i<T 



\znit)-r{t)\ < e 



B{Zn,T)>B \ =1. 



•1) 



The proof is standard: see [9]. 

It is because of Theorem [8] and (j8.1|) of Theorem [9] that we are motivated to 
study uniqueness for solutions to Problem A. This concludes our discussion 
of the connection between the probability and variational problems. We 
return to the study of the variational problem. 

Suppose that there is a unique upcrossing point x*, the lowest cost point 
from q to the hyperplane (x, a) = C . Consider the local cost function 
£{x*,y), which is defined for any {x,y) in ()7.4p . When viewed as a constant 
coefficient cost i{y), by [HJ Chapter 5.2] £{x*,y) satisfies Assumption [1] [A] , 
[B] and [E] and, for nontrivial Markov models, also [D]. When combined 
with the functional B given in (j7.ip . it is easy to check that all of Assump- 
tion [T] [A]-[F] hold (see P Chapter 5.2] for properties of £{y), Chapter 13 
for properties of B). Therefore, the solution to Problem A for constant co- 
efficient cost function, with paths starting at x* making buffer at least B, 
exists and is unique. For the case B = 1 we call the resulting solution r{t), 
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and the time T. Actually, the path may start at any xi with {x, a) = C, as 
long as we take the cost function given by £{x*,y), not i{xi,y), and then the 
solution will be f^t) + xi — x* , since I[o,t] is invariant under shifts, while B 
is invariant under shifts along the hyperplane {x : {x,a) = 0}. Furthermore, 
our scaling property gives the optimal path for any B ^ 1 as a scaled version 
of r , namely af{t/a) + x* — ax* , for < t < Ta, where a = \fB. 

We now switch back to cost function y) depending on x. Many 
properties of this function are detailed in [SI Chapter 5]. If the positive 
cone spanned by the is the entire space M^, and if all Aj(x) > 0, then 
< ^(x, y) < oo, and l{x^y) is convex in y. [SI Thm. 5.35] shows that 
for any e > 0, c > 0, there exists a 5 > such that if J[o,t](^) is defined 
to be the same as /[o,r](^) except using the local cost ^(x*, ^r{t)), and if 
J[o,T]{r) < c and \Xi{f{t)) - Xi{x*)\ < 6 then |/[o,r](^) - J[o,T]{r)\ < £• In 
other words, the functional /[o,t] is uniformly continuous in sets of bounded 
cost. Also, [S] Prop. 5.46] shows that for any c, T < oo, the set of f{t) with 
f (0) in a compact set, and with /[o,t](^) < c, is compact. Compactness is 
in the sup norm topology for the paths in [0, T] — > M^. 

The basis of our argument is that when B is small, paths ^^(t), < 
t < Tb, can stay very near r_B(0) and have Tb small, and still make 
B{fB,TB) = B. So the local cost function £{rB{t), B{t)) is very nearly 
equal to £{f b{0), sit)), a constant coefficient cost, for which we know 
uniqueness applies. This motivates the following cost function, which is 
based on considering a small neighborhood of ^^(0). Given B and r ^(0) 
with (fB(0),a) = C, define 

iB{x,y) = £ (fBiO) + Vb{x - fBm,y) . (8.2) 
For any such path r B{t) that has B{f{TB)) = B we define a scaled path 

SB{t) = r i?(0) + (rBitVB) - f b(0)) , 0<t< Tb/Vb. (8.3) 
A simple calculation shows that 

b(^sb,Tb/Vb^ =1. (8.4) 



14 



Now we find 



'0 



Tb/v^ / d \ 

[^B{t),j^SB{t)j dt 

^^^^iB b(0) + -^(f B(t/B) - r b(0)), ^^fBitVB)^ dt 

" r-B(O) + {rB{t^/B) - f ^(0)), j-^r B{t^/B)\ dt (8-5) 



1 1'^" J ^ , . d 



B Jo \ du 



rsiu), -i-rB{u) du. 



It is easy to show that, under Assumption [2] E, as S ^ 0, minimal 
solutions to Problem A starting from r ^(0) with (r ^(0), a) = C must have 
Tb/VB bounded, since there are paths f{t) that have T jy/B bounded, and 
have cost of order \/^, and any path that stays above {f{t),d) = C for time 
T has cost that is bounded below by a function linear in T. Therefore, if we 
consider solutions to Problem A with buffer size B small, then the scaled 
problem with £b cost function has solution sb in bounded time Tb/^/B. 

Theorem 10 Suppose all of Assumption holds, and further that the up- 
crossing point X* is unique. For any set of paths r Bit) satisfying B{f{TB)) = 
B and with minimal cost, starting from the point q, the scaled paths SB{t) 
satisfy the following. 

lim ^ = T (8.6) 

B^o ^ 

lim SB^t) = f{t), < t < T, uniformly in t. (8-7) 

B — >0 

This theorem gives a connection between solutions to Problem A for constant 
coefficient costs, and solutions with costs depending on x, but for small buffer 
B. Proof of existence of solutions to Problem A for non constant coefficient 
costs is the same as the proof for Theorem [TJ 

Proof: By [8l Prop. 5.46], the paths SB{t) lie in a compact set, since 
they have bounded cost and their initial points s*b(0) approach x* . Take a 
convergent subsequence of sb- By [U Thm. 5.35], the costs (based on Ib) of 
these paths converge to the cost of the constant coefficient path starting at 
X* and making buffer size 1 in time T. But Theorem [2] shows that this path 
is unique among paths that start at x* and make buffer size 1. Therefore 
any limiting sequence of the sb must converge to the same path, and do so 
uniformly, and their times must converge also. ■ 
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We note that the point x* will be unique if the Markov chain can be 
written as a superposition of sources, either an open model (with product- 
form Poisson steady-state distribution) or a closed model (with multinomial 
distribution). In these cases, x* is the solution of Sanov's theorem (see [SI 
Chapter 2]). Explicitly, if the steady-state distribution of the chain is 7r(z), 
1 < i < K , then the upcrossing point is given by the minimum entropy point 
(i.e., minimum Kullback-Leibler measure) on the hyperplane {x,a) = C. If 
the level curves of this entropy are strictly convex, then the point x* is 
unique. But it is easy to see that these level curves are strictly convex for 
the two models under study, and the strict convexity also holds in the limit 
as we scale n — > cxd. 

9 Strong uniqueness 

The preceding result may be combined with traditional variational calculus 
to show strong (true) uniqueness for the solution to Problem A from a given 
initial point r(0) where (r(0),a) = C. As mentioned before, this result 
still does not give full uniqueness for the steady-state variational problem, 
because that problem has r (0) = q where q is the unique attracting point 
for the fluid limit i*oo(i), and which satisfies (g*, a) < C. Nevertheless, it is a 
step in that direction. 

Theorem 11 If the positive cone of the {cj} equals M^, and logAj(x) are 
Lipschitz and functions, then given x* with {x* , a) = C, there are Bq 
and 6 > so that for all B < Bq and \x — x*\ < S with {x,a) = C, the 
solution to Problem A starting at r (0) = x is unique. 
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